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2000-0048 

METHOD AND DEVICE FOR EFFICIENT BANDWIDTH MANAGEMENT 

Field of the Invention 

The present invention relates generally to bandwidth management, and more 
particularly to dynamic, real-time bandwidth management of traffic in Internet Protocol 
networks. 

Background of the Invention 

Today's Internet Protocol (IP) networks mostly work as one-class, best-effort 
networks. As these networks evolve to Quality of Service (QoS)-enabled, multi-class, 
application-aware networks, bandwidth management will be one of the crucial resource 
management mechanisms to insure each application a fair share of bandwidth, especially 
at congestion points. There are several products, called bandwidth managers or packet 
shapers, that offer such a mechanism at the access points to or from the Wide Area 
Network (WAN). In particular, one such scheme, Class Based Queuing (CBQ), has 
gained significant popularity after being implemented in real bandwidth management 
products such as Xedia's Access Point® to guarantee bandwidth for applications and 
provide Quality of Service differentiation. Products offering CBQ are widely available 
and are being deployed in the field to guarantee bandwidth for real-time and other 
business -critical applications (e.g., voice, e-transactions). However, a challenging 
problem in putting these products into practical use is the need to configure them in a 
way that will match the needs of the particular site and links, whose bandwidth is 
allocated. There is a need for a method and device that dynamically provide real-time 
allocation of bandwidth for real-time and non-real-time applications based on 
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measurements, thus enabling the use of bandwidth managers without the administrative 
burden of manual configuration and update. 

Summary of the Invention 

The present invention provides a method for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ), The method includes the steps of maintaining a minimized reserved 
portion of bandwidth to minimize delay jitter and maximizing a shared portion of 
bandwidth to maximize overall bandwidth utilization. Allocation of bandwidth may be 
based on a hierarchical-tree sharing scheme that provides for temporary borrowing of 
bandwidth by real-time or critical applications from bandwidth of non-real-time or non- 
critical applications and prevents borrowing of bandwidth by non-real-time or non- 
critical applications from bandwidth of real-time or critical applications. The DSS 
provides for using measurable parameters, such as queue length or number of borrowing 
attempts per a predetermined length of time, as control triggers for implementing 
adjustment of bandwidth allocation. 

The present invention may also provide for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ) using the steps of measuring a predetermined parameter at 
predetermined observation window times and dynamically adjusting allocated bandwidth 
for parent classes of real-time or critical traffic by adjusting an average of the 
predetermined parameter to have a value within a predetermined stable region. Again, 
dynamically adjusting allocated bandwidth, such as the DDS method of the present 
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invention, may be based on a sharing tree hierarchical scheme that provides for 
temporary borrowing of bandwidth by real-time or critical applications from bandwidth 
of non-real-time or non-critical applications and blocks borrowing of bandwidth by non- 
real-time or non-critical applications from bandwidth of real-time or critical applications. 
The predetermined parameter measured may, for example, be queue length or number of 
borrowing attempts during a predetermined measurement window. Where the 
predetermined parameter is a number of borrowing attempts during a measurement 
window, a maximum bandwidth and a minimum bandwidth for the predetermined stable 
region may be determined by the following algorithm, where the subscript i stands for 
class i: 

IfAi avg < Thr(A$™ e \ B 2 = maximum^ - w? ow \Min(B$) 

Else IfA^g > Thr(A^ pe \ B x = minimum(B t + a} t up , Max(Bi)) 

where A t is a number of borrowing attempts by class i during a most recent 
measurement window and 

Aj avg is an average number of borrowing attempts/controlled state; 

upper and lower thresholds for the predetermined stable region are preset at 
predetermined values: 

Thr(A$™ er is a lower threshold for borrowing attempts, where Thr(AJ lower > 0; 
Thr(AJ upper is a upper threshold for borrowing attempts, where Thr(Af pper > Thr(KJ lower ; 

tiie increment and decrement units (of° wn and a>t p , which denote the update granularity 
on allocated bandwidth B l9 are preset at predetermined values; 
Max(B^) is a maximum value of allocated bandwidth; 
Min(Bi) is a minimum value of allocated bandwidth; and 
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exponential smoothing technique is used as follows, 

where a value of a is preselected as a negative power of two and ^4, is updated every 
observation window, a pre-determined parameter in seconds. 
Where the predetermined parameter is a queue length, a lower threshold and an 
upper threshold for queue length for the predetermined stable region may be determined 

by: 

IfQ*_avg < Thr(Q l ) lower , Bi = maximum(B l - o) l? Min(Bd) 

Else IfQ l _ avg > Thr(Q/ pper , B t = minimum^ + , Max(B)\ 

Q l is an instantaneous measurement of queue length; 

Q i_wg is a calculated average value for an average queue length; 

upper and lower thresholds are preset at predetermined values: 

Thr(QJ lower is a lower threshold for queue length, where Thr(QO lower > 0; and 

7Jir(Qi) upper is an upper threshold for queue length where Thr(Q) upper > 
Thr(Qt) lower . 

The queue size for class /, which is also the upper bound for the queue length Q, , is related to an 
upper bound on the delay jitter as: 

Delay jitter _i = maxQj/Bi 
Hence, if a jitter upper bound Delay Jitter J is preselected, then a linear relationship exists 
between maxg, and B x , the allocated bandwidth. 

The present invention may also be implemented by a computer-readable medium 
having computer-executable instructions for dynamically managing allocation of 
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bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ). The computer-executable instructions may include measuring a 
predetermined parameter at predetermined observation window times and dynamically 
adjusting allocated bandwidth for parent classes of real-time or critical traffic by 
adjusting an average of the predetermined parameter to have a value within a 
predetermined stable region. 

The present invention may be implemented by a device that includes a parameter 
measuring unit and a bandwidth sharing determining unit. The parameter measuring unit 
is coupled to the bandwidth sharing determining unit and is used for (i) measuring a 
predetermined parameter at predetermined observation window times, and (ii) 
dynamically adjusting allocated bandwidth for parent classes of real-time or critical 
traffic by adjusting an average of the predetermined parameter to have a value within a 
predetermined stable region. The DSS generally provides for using measurable 
parameters such as queue length or number of borrowing attempts per a predetermined 
length of time or predetermined measurement window as control triggers for 
implementing adjustment of bandwidth allocation. Where the predetermined parameter 
is a number of borrowing attempts during a measurement window of the DDS method, a 
maximum bandwidth and a minimum bandwidth for the predetermined stable region may 
be determined as described above. Where the predetermined parameter is a queue length 
of the DDS method, a lower threshold and an upper threshold for queue length for the 
predetermined stable region may be determined as described above. 
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Brief Description of the Drawings 

The foregoing summary of the invention, as well as the following detailed 
description of preferred embodiments, is better understood when read in conjunction with 
the accompanying drawings, which are included by way of example, and not by way of 
limitation with regard to the claimed invention. 

Figure 1 is a schematic representation of a sharing tree hierarchy with three 
control states generated using limits and thresholds in accordance with the present 
invention. 

Figure 2 is a flow chart showing steps for one embodiment of a method for 
dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ) in accordance with the present 
invention. 

Figure 3 is a flow chart and block diagram showing another embodiment of steps 
of a method and of a computer-readable medium for dynamically managing allocation of 
bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for Class Based 
Queuing (CBQ) in accordance with the present invention. 

Figure 4 is a block diagram showing one embodiment of a device for dynamically 
managing allocation of bandwidth in a packet network using a Dynamic Setting Scheme 
(DSS) for Class Based Queuing (CBQ) in accordance with the present invention. 

Detailed Description of the Preferred Embodiments 

In previous implementations, classes with heavy- volume traffic tended to 
dominate the bandwidth for a relatively long period of time and cause a high delay jitter 
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for classes with light traffic volume even if the latter were allocated sufficient bandwidth. 
Since the traffic volume of some real-time applications, e.g., voice, is relatively low and 
the bandwidth consumption of such applications is more predictable, it is desirable to 
separate these applications from the rest of the traffic, which includes many data 
applications with unpredictable volume and bursty bandwidth consumption. However, 
while total separation provides security, it also reduces the total utilization of bandwidth. 
One alternative is to allow voice traffic to borrow bandwidth from data traffic, but not 
allow data to borrow from voice. In this situation, one wants to reserve sufficient 
bandwidth for voice and, at the same time, avoid over-engineering in order to increase the 
bandwidth utilization. 

Due to the fact that traffic conditions are dynamic and somewhat unpredictable, it 
is not possible to find a value for bandwidth allocation that satisfies the desired objectives 
in all circumstances. The present invention implements a bandwidth sharing hierarchy 
and a dynamic scheme for setting bandwidth management parameters. Since Internet 
Protocol (IP) technology is implemented in various access methods, i.e., Cable Plant, 
fixed wireless, and DSL, and also in the backbone, the present invention has far-reaching 
applicability in the present and future networks. The present invention provides 
capabilities for more efficient use of bandwidth and the ability to use the same network 
for both voice and data applications. Moreover, the present invention provides for 
integrating voice traffic and data traffic and provides mechanisms for allocation of 
bandwidth to priority data or voice-over-IP (VOIP) services that ensure that valuable 
corporate resources are available to critical business applications. 
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For example, where bandwidth is allocated according to application delay 
requirements, assume that there are two types of traffic: real-time and non-real-time 
traffic. There are a predetermined number n of classes, and each type of traffic may have 
one or more leaf classes: ci through c^ are classes of real-time or other critical 
applications, while the remaining classes Ck+i through c n include non-critical applications. 
The objectives are twofold: 

1. Minimize the delay jitter for real-time applications by reserving sufficient 
bandwidth. 

2. Maximize the overall bandwidth utilization by allowing bandwidth sharing across 
non- real-time applications. 

The above goals are achieved by setting a borrowing permit according to the 
traffic's delay requirement, i.e., only allowing real-time applications to borrow from non- 
real-time, but not vice versa. As a result, one needs an extra level in the sharing tree 
hierarchy as is shown in Figure 1. If Ci exceeds its allocated bandwidth, it can temporarily 
borrow from all its parent classes, i.e., RT 104 and Root 102. On the other hand, if c<k+i) 
exceeds its allocation, it can only borrow from NON-RT 106. Such a sharing hierarchy 
includes reservation and sharing strategies. However, due to the traffic dynamics, a static 
allocation that meets the performance objectives in all circumstances has not been 
available. To guarantee real-time application delay requirements, one needs to allocate 
sufficient bandwidth to such applications. On the other hand, to maximize the bandwidth 
utilization, one must maintain the reserved portion of bandwidth as small as possible and 
maximize the shared portion. 
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For a better tradeoff between guaranteeing delay and maximizing the utilization, 
the present invention provides a dynamic scheme that adapts to traffic variations. The 
present invention utilizes a scheme that is simple enough to be readily implemented - a 
dynamic setting scheme (DSS) for CBQ. The fundamental concept embedded in DSS is 
the use of measurable parameters as control triggers. The measurable parameters may be 
related to performance objectives. For example, queue length may be directly related to 
delay and delay jitter, which are the main performance measures for real-time traffic. 
Moreover, borrowing attempts may be used to indicate whether the allocated bandwidth 
is sufficient. Both queue length and borrowing attempts are easily measured and therefore 
may be used as control triggers in a DSS scheme. However, other measurable parameters 
can be used as control triggers in the DSS scheme. 

Two examples of DSS are described below wherein queue length and borrowing 
attempts are used as control triggers. In the first example, where DSS is triggered by 
borrowing attempts, let A* be the number of borrowing attempts initiated by class i during 
an observation window. An "observation window" is a time interval during which the Ai 
is measured. The objective of DSS is to dynamically adjust the allocated bandwidth for 
parent classes of real-time or critical traffic according to the number of borrowing 
attempts made by these classes during the most recent observation window. Since the 
traffic characteristics are unknown and changing, it is impossible to find an optimal Ai 
that suits all circumstances. However, by keeping the above state variable within a 
desired region and allowing a certain degree of fluctuation within the desired region, the 
performance is kept at a satisfactory level. Therefore, two levels of thresholds are used 
for A is the desired region being designated as the "stable region". The performance is 
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measured in terms of the delay and delay jitter of real-time classes and the utilization of 
the root class (which accounts for the total traffic). 

The DSS scheme uses the average number of borrowing attempts, A* avg , to trigger 
the control actions. The status of the state variable is checked on a periodic basis. If the 
state variable is in the stable region, no action needs to be taken. If the state variable is 
outside the stable region, the allocated bandwidth Bj for the real-time class is updated, 
moving Ai avg back into the stable region. As is known in the art, an exponential 
smoothing technique is used to calculate the average number of borrowing attempts. Such 
a smoothing technique avoids too much oscillation due to the effect of overreacting to the 
system's instantaneous fluctuations. The implication is that as long as the smoothed 
average values stay inside the stable region, certain incidences are permitted wherein the 
actual values of the state variable are outside the stable region, either higher than the 
upper threshold or lower than the lower threshold. 

The parameters used in the algorithm are defined as follows. The first set of 
parameters includes the instantaneous measurement on the state variable and its 
calculated average value: 

• Ai: the number of borrowing attempts during the last measurement window; and 

• Ai avg : the average borrowing attempts. 

The following set of parameters consists of the upper and lower thresholds on the above 
state variable which are preset at predetermined desired values: 

• Thr(Ai) lower : the lower threshold for borrowing attempts, e.g. Thr(Ai) lower =2. One 
should note that Thr(Ai) lower cannot be set to zero. 
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• Thr(Ai) upper : the upper threshold for borrowing attempts, e.g. Thr(Ai) upper =10. 

The next parameter is the increment or decrement unit on the allocated bandwidth Bi 
preset at a predetermined value (where i stands for class i): 

• a? t dowri : the downward update granularity for allocated bandwidth B*; 

• a)i up : the upward update granularity for allocated bandwidth Bi; 

The last two parameters are the upper and lower limits on the allocated bandwidth that 
are typically selected according to applications being used: 

• Max(Bi): maximum value of allocated bandwidth; 

• Min(Bi): minimum value of allocated bandwidth. 

The average state variables may be obtained using the exponential smoothing technique 
as follows: 

Ai_avg <- (l-a)*Aj _avg + Or Aj , 
where the value of a is chosen as a (negative) power of two, i.e., 2" n , n=0, 1, 2, which 
may be implemented with one shift and two additions. Aj_ aV g is updated every observation 
window, generally a pre-determined parameter in seconds. 

Using the limits and the thresholds, three states are generated for control 
purposes, as is shown in Figure 3. Ai avg represents a controlled state. As long as the 
controlled state is outside the stable region, the value of allocated bandwidth Bi will be 
updated to move the controlled state back to the stable region. Hence, the algorithm for 
DSS (306) is as follows: 

If Ai avg < Thr(Ai) Iower , Bi = maximum(Bi - cof° wn Min(Bi)) 

Else If A Lavg > Thr(Ai) upper , Bi = minimum(Bi + Max(Bi)) 

11 
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In the second example, where DSS is triggered by queue length, queue length is 
used to trigger the DSS so as to control the delay jitter since delay jitter is one of the main 
performance measures in voice-over-IP applications. Queue length is selected as a 
control trigger because voice traffic needs to be given strict high priority while traversing 
the network. Thus, generally voice traffic will not encounter excessive queuing delay 
inside the network, and, for a given path, the propagation delay is fixed. Hence, the only 
source for delay jitter for voice traffic will be at the ingress queue. Moreover, where 
bandwidth is reserved for voice traffic at the bandwidth manager, the queue length Qi for 
class i may be related to the upper bound of delay jitter as: 

DelayJitterJ = Qi/Bi 

such that, where the desired jitter upper bound Delayjitter_i is given, then a linear 
relationship exists between Qi and Bi (allocated bandwidth) (308). 

The parameters used in the second example are defined as follows. The first set of 
parameters includes the instantaneous measurement on the state variable and its 
calculated average value: 

• Qi: the queue length; 

• Q i_av g : the average queue length. 

The following set of parameters consists of the upper and lower thresholds on the above 
state variable which are preset at predetermined values: 

• Thr(Qi) lower : the lower threshold for queue length, e.g., Thr(Qi) lower =2. One should 
note that Thr(Qi) Iower cannot be set to zero. 
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• Thr(QO upper : the upper threshold for queue length, e.g. Thr(Qi) upper =10. 
As is clear from the explanation above, replacing Ai_ a v g of the above DSS algorithm by 
Qi_av g yields a DSS triggered by queue length. 

Thus, as shown in Figure 2, the present invention may be implemented as a 
method for dynamically managing allocation of bandwidth in a packet network using a 
Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ). The steps of the 
method include: maintaining (202) a minimized reserved portion of bandwidth to 
minimize delay jitter and maximizing (204) a shared portion of bandwidth to maximize 
overall bandwidth utilization. Allocation of bandwidth may be based on a sharing tree 
hierarchical scheme that provides for temporary borrowing of bandwidth by real-time or 
critical applications from bandwidth of non-real-time or non-critical applications and 
blocks borrowing of bandwidth by non-real-time or non-critical applications from 
bandwidth of real-time or critical applications. The DSS may provide for using 
measurable parameters such as queue length or number of borrowing attempts per a 
predetermined length of time as control triggers for implementing adjustment of 
bandwidth allocation. 

In another embodiment, as shown in Figure 3, the method of the present invention 
provides for dynamically managing allocation of bandwidth in a packet network using a 
Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ), by utilizing the steps 
of: measuring (302) a predetermined parameter at predetermined observation window 
times and 

dynamically adjusting (304) allocated bandwidth for parent classes of real-time or critical 
traffic by adjusting an average of the predetermined parameter to have a value within a 
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predetermined stable region. Where the predetermined parameter is a number of 
borrowing attempts during a measurement window, a maximum bandwidth and a 
minimum bandwidth for the predetermined stable region may be determined (306) by: 
IfA i avg < Thr(AJ lower , B x = maximum^ - cof own ,Min(B$) 

ElselfA i avg > Thr(A/ pper , B t = mimmumfB, + a? p , Maxfo)) 

Where A, is a number of borrowing attempts during a most recent 
measurement window and 

A i aV g is an average number of borrowing attempts/controlled state; 
upper and lower thresholds for the predetermined stable region are preset 
at predetermined values: 

ThrfAJ 1 ™^ is a lower threshold for borrowing attempts, where 

Thr(KJ lower >0<, 

Thr(A^ upper is a upper threshold for borrowing attempts, where 
Thr(A/ pper > TkrfAO 1 *""; 

increment and decrement units <p/ ow " and a£ p 9 which denote the update 
granularity on allocated bandwidth B h are preset at predetermined values; 
MaxfBi) is a maximum value of allocated bandwidth; 
Min(Bi) is a minimum value of allocated bandwidth; and 
exponential smoothing technique is used as follows, 

Ai avg ^~ (l-&)*A t aV g + CC*Aj , 

where a value of a is preselected as a negative power of two and A lJS9g is 
updated every observation window, a pre-determined parameter in 
seconds. 
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Where the predetermined parameter is a queue length, a lower threshold and an upper 
threshold for queue length for the predetermined stable region may be determined (308) 
by: 

IfQij** < Thr(Qj ower , B l = maximum(B t - a)? own , Minfa)) 

ElseIfQ i avg > Thr(QJ upper , 5, = minimum^ + a> l up ) Max(Bi)), 

Q % is an instantaneous measurement of queue length; 

Q i_avg is a calculated average value for an average queue length; 

upper and lower thresholds are preset at predetermined values: 

ThrfQ)*™" is a lower threshold for queue length, where Thr(Q) loyver > 0; and 

Thr(QO upper is an upper threshold for queue length where Thr(Qi) upper > 

Thr(QO lower . 

A queue size for class i, which is also an upper bound for a queue length Q l , is related to an upper 
bound on a delay jitter as: 

Delay jitter J = m3xQi/B t 

Hence, if a jitter upper bound Delay Jitter J is preselected, then a linear relationship exists 
between maxg, and 5, , the allocated bandwidth. 

In one embodiment, as shown in Figure 3, a computer-readable medium 310 
having computer-executable instructions may be utilized for dynamically managing 
allocation of bandwidth in a packet network using a Dynamic Setting Scheme (DSS) for 
Class Based Queuing (CBQ), wherein the computer-executable instructions comprise the 
steps of: measuring (302) a predetermined parameter at predetermined observation 
window times and dynamically adjusting (304) allocated bandwidth for parent classes of 
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real-time or critical traffic by adjusting an average of the predetermined parameter to 
have a value within a predetermined stable region. The steps of the computer-executable 
instructions may also be implemented as described above for the method. 

Figure 4 is a block diagram showing one embodiment of a device (406) for 
dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ). The device (406) typically 
includes a parameter measuring unit (402) and a bandwidth sharing determining unit 
(404). The parameter measuring unit (402) is coupled to a bandwidth sharing 
determining unit (404), and measures a predetermined parameter at predetermined 
observation window times. The bandwidth sharing determining unit (404) is coupled to 
the parameter measuring unit (402), and dynamically adjusts allocated bandwidth for 
parent classes of real-time or critical traffic by adjusting an average of the predetermined 
parameter to have a value within a predetermined stable region. Typically, the DSS 
provides for using measurable parameters such as queue length or number of borrowing 
attempts per a predetermined length of time or window of time as control triggers for 
implementing adjustment of bandwidth allocation. Where the predetermined parameter 
is a number of borrowing attempts during a measurement window, a maximum 
bandwidth and a minimum bandwidth for the predetermined stable region may be 
determined by: 

IfA avg < Thr(A$°™\ B, = maximum(B l - <0?™ n ,Min(B$) 
Else IfA iavg > Thr(AJ upper , B t = minimum^ + of*, MaxfB,)) 
as described more fully above. Where the predetermined parameter is a queue length, and 

a lower threshold and an upper threshold for queue length for the predetermined stable 

region may be determined by: 
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VQing < Thr(Q) hwer , B t = maximum^ - a)f own fi Min(Bi)) 
Else IfQ lJsvg > Thr(QJ upper } B t = minimum^ + co^ Max(B t )l 
as described more fully above. The dynamically adjusted allocated bandwidth for real- 
time or critical applications and non-real-time or non-critical applications is sent by the 
bandwidth sharing determining unit (404) to a bandwidth manager or traffic shaper (408), 
which then sends information on the real-time or critical applications and non-real-time 
or non-critical applications seeking to use the bandwidth to the parameter measuring unit 
(402). 

Although the present invention has been described in relation to particular 
preferred embodiments thereof, many variations, equivalents, modifications and other 
uses will become apparent to those skilled in the art. It is preferred, therefore, that the 
present invention be limited not by the specific disclosure herein, but only by the 
appended claims. 

What is claimed is: 



17 



2000-0048 



CLAIMS 

1 . A method for dynamically managing allocation of bandwidth in a packet network 
using a Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ), comprising the 
steps of: 

maintaining a minimized reserved portion of bandwidth to minimize delay 
jitter; and 

maximizing a shared portion of bandwidth to maximize overall bandwidth 
utilization. 

2. The method of claim 1 wherein allocation of bandwidth is based on a sharing tree 
hierarchical scheme that provides for temporary borrowing of bandwidth by real-time 
applications from bandwidth of non-real-time applications and blocks borrowing of 
bandwidth by non-real-time applications from bandwidth of real-time applications. 

3. The method of claim 1 wherein the DSS provides for using measurable 
parameters as control triggers for implementing adjustment of bandwidth allocation. 

4. The method of claim 3 wherein the measurable parameters include at least one of: 
queue length and number of borrowing attempts per a predetermined length of time. 

5. A method for dynamically managing allocation of bandwidth in a packet network 
using a Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ), comprising the 
steps of: 

measuring a predetermined parameter at predetermined observation 
window times; and 
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dynamically adjusting allocated bandwidth for parent classes of real-time 
traffic by adjusting an average of the predetermined parameter to have a 
value within a predetermined stable region. 

6. The method of claim 5 wherein dynamically adjusting allocated bandwidth is 
based on a sharing tree hierarchical scheme that provides for temporary borrowing of 
bandwidth by real-time applications from bandwidth of non-real-time applications and 
blocks borrowing of bandwidth by non-real-time applications from bandwidth of real- 
time applications. 

7. The method of claim 5 wherein the predetermined parameter measured is one of: 
queue length and number of borrowing attempts during a predetermined measurement 
window. 

8. The method of claim 5, where the predetermined parameter is a number of 
borrowing attempts during a measurement window, and a maximum bandwidth and a 
minimum bandwidth for the predetermined stable region are determined by: 

IfA iavg < Thr(AJ lower , B, = maximum^ - o>? own ,Mn(B t )) 

Else IfA i avg > Thr(AJ upper , B t - minimum^ + Max(B>)) 

Where A t is a number of borrowing attempts during a most recent 
measurement window and 

A i avg is an average number of borrowing attempts/controlled state; 

upper and lower thresholds for the predetermined stable region are preset 
at predetermined values: 

Thr(AJ hwer is a lower threshold for borrowing attempts, where 

Thr(A i } Iomr >0- 9 
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Thr(AJ upper is an upper threshold for borrowing attempts, where 
Thr(A/ pper >Thr(k^ we \ 

increment and decrement units (Q?™ n and co z up , which denote an update 
granularity on allocated bandwidth B u are preset at predetermined values; 
Max(B^ is a maximum value of allocated bandwidth; 

Min(B t ) is a minimum value of allocated bandwidth; and 
exponential smoothing technique is used as follows, 

At avg <- (l-cL)*A i avg + a*Ai , 

where a value of a is preselected as a negative power of two and A t _ m is 
updated every observation window, a pre-determined parameter in 
seconds. 



9. The method of claim 5, where the predetermined parameter is a queue length, and 
a lower threshold and an upper threshold for queue length for the predetermined stable 
region are determined by: 

IfQtjw < Thr(Q$™ e \ B 7 = maximum^ - cof™" , ASnfo)) 

Else IfQ i avg > TkrfQf*", fl, = minimumfB, + MdxfBdX 

Qj is an instantaneous measurement of queue length; 

Q i_avg is a calculated average value for an average queue length; 
upper and lower thresholds are preset at predetermined values: 
Thr(QJ hwer is a lower threshold for queue length, where ThrfQJ 10 ™^ 0; 

Thr(Qt) upper is an upper threshold for queue length where Thr(Qi) upper > 
ThrfQ^; and 
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a queue size for class z , which is also an upper bound for a queue length Q { , is related to an upper 
bound on a delay jitter as: 

Delay jitter _i = maxg, /Bj 

wherein, if a jitter upper bound Delay jitter J is preselected, then a linear relationship exists 
between maxig, and B { , an allocated bandwidth. 

10. A computer-readable medium having computer-executable instructions for 
dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ), wherein the computer- 
executable instructions comprise the steps of: 

measuring a predetermined parameter at predetermined observation 
window times; and 

dynamically adjusting allocated bandwidth for parent classes of real-time 
traffic by adjusting an average of the predetermined parameter to have a 
value within a predetermined stable region. 

11. The computer-readable medium of claim 10 wherein dynamically adjusting 
allocated bandwidth is based on a sharing tree hierarchical scheme that provides for 
temporary borrowing of bandwidth by real-time applications from bandwidth of non-real- 
time applications and blocks borrowing of bandwidth by non-real-time applications from 
bandwidth of real-time applications. 
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12. The computer-readable medium of claim 10 wherein the predetermined parameter 
measured is one of: queue length and number of borrowing attempts during a 
predetermined measurement window. 

13. The computer-readable medium of claim 10, where the predetermined parameter 
is a number of borrowing attempts during a measurement window, and a maximum 
bandwidth and a minimum bandwidth for the predetermined stable region are determined 
by: 

IfA i avg < Thr(A$°™ r , B, = maximum^ - cof own ,Mn(B$) 

Else IfA i avg > ThrfAr^ B t = minimum^ + Max(B)) 

Where Ai is a number of borrowing attempts during a most recent 
measurement window and 

A j avg is an average number of borrowing attempts/controlled state; 

upper and lower thresholds for the predetermined stable region are preset 
at predetermined values: 

Thr(AJ hwer is a lower threshold for borrowing attempts, where 



Thr(Aj) upper is an upper threshold for borrowing attempts, where 
Thr(A^ upper > Thr(A ] ) hwer ; 

increment and decrement units ca?™ n and co? p , which denote the update 
granularity on allocated bandwidth B u are preset at predetermined values; 
Max(B t ) is a maximum value of allocated bandwidth; 
MinfBf) is a minimum value of allocated bandwidth; and 
exponential smoothing technique is used as follows, 
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A Lavg <- (l-a)*A Lavg + a*A t , 

where a value of a is preselected as a negative power of two and A iavg is 
updated every observation window, a predetermined parameter in 
seconds. 

14. The computer-readable medium of claim 10, where the predetermined parameter 
is a queue length, and a lower threshold and an upper threshold for queue length for the 
predetermined stable region are determined by: 

IfQuw < Thr(Q$™ er y B 2 = maximum^ - wf own ,Min(B 2 )) 

Else IfQ^ > Thr(Q/ pper , B t = minimum^ + co^ Max(B t )) 9 
Q t is an instantaneous measurement of queue length; 

Q i_ayg is a calculated average value for an average queue length; 
upper and lower thresholds are preset at predetermined values: 
Thr(Q) lower is a lower threshold for queue length, where Thr(QJ lower > 0; 
Thr(QJ upper is an upper threshold for queue length where Thr(ty upper > 

a queue size for class z, which is also an upper bound for a queue length Q % , is related to an upper 
bound on a delay jitter as: 

Delay Jitter J = maxQt /B t 

wherein, if a jitter upper bound Delay jitter J is preselected, then a linear relationship exists 
between maxg, and B 2 , an allocated bandwidth. 
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15. A device for dynamically managing allocation of bandwidth in a packet network 
using a Dynamic Setting Scheme (DSS) for Class Based Queuing (CBQ), comprising: 

a parameter measuring unit, coupled to a bandwidth sharing determining 
unit, for measuring a predetermined parameter at predetermined 
observation window times; and 

the bandwidth sharing determining unit, coupled to the parameter 
measuring unit, for dynamically adjusting allocated bandwidth for parent 
classes of real-time traffic by adjusting an average of the predetermined 
parameter to have a value within a predetermined stable region. 

16. The device of claim 15 wherein the DSS for bandwidth allocation is based on a 
sharing tree hierarchical scheme that provides for temporary borrowing of bandwidth by 
real-time applications from bandwidth of non-real-time applications and blocks 
borrowing of bandwidth by non-real-time applications from bandwidth of real-time 
applications. 

17. The device of claim 15 wherein the DSS provides for using measurable 
parameters as control triggers for implementing adjustment of bandwidth allocation. 

18. The device of claim 15 wherein the measurable parameters include at least one of: 
queue length and number of borrowing attempts per a predetermined length of time. 

19. The device of claim 1 5, where the predetermined parameter is a number of 

borrowing attempts during a measurement window, and a maximum bandwidth and a 

minimum bandwidth for the predetermined stable region are determined by: 

IfA iavg < ThrfAt) 10 ™ B t = maximum^ - 6)? own ,Mm(B t )) 
Else IfA iavg > Thr(Ai) upper , B, = minimum^ + co? v , Max(B 2 )) 
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Where A, is a number of borrowing attempts during a most recent 
measurement window and 

A lJxvg is an average number of borrowing attempts/controlled state; 
upper and lower thresholds for the predetermined stable region are preset 
at predetermined values: 

ThrfAJ 2 ™*'' is a lower threshold for borrowing attempts, where 

Thr(Ai) lower >fy 

Thr(A/ pper is an upper threshold for borrowing attempts, where 
Thr(Af pper > ThrfAJ 10 ™; 

increment and decrement units a)f omi and co t up , which denote the update 
granularity on allocated bandwidth B t , are preset at predetermined values; 
Max(Bi) is a maximum value of allocated bandwidth; 
Min(B t ) is a minimum value of allocated bandwidth; and 
exponential smoothing technique is used as follows, 

Ai avg ^~ (l~v*)*A i aV g + OC^Aj y 

where a value of a is preselected as a negative power of two and A ijr , g is 
updated every observation window, a pre-determined parameter in 
seconds. 



20. The device of claim 15, where the predetermined parameter is a queue length, and 
a lower threshold and an upper threshold for queue length for the predetermined stable 
region are determined by: 

IfQ*_a* < Thr(QJ lower , B t = maximum^ - (of ow \ MinfBd) 

Else IfQ iJKg > Thr(QJ upper , Bi = minimumfBi + <o? p , Max(B t )l 
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Qj is an instantaneous measurement of queue length; 
Q i_ayg is a calculated average value for an average queue length; 
upper and lower thresholds are preset at predetermined values: 
Thr(QJ Iower is a lower threshold for queue length, where Thr(Q^) lower > 0; 

Thr(ty upper is an upper threshold for queue length where Thr(ty upper > 
Thr(QO lower ;md 

a queue size for class /, which is also an upper bound for a queue length 0* , is related to an upper 
bound on a delay jitter as: 

Delay jitter _i = maxQj/Bi 

wherein, if a jitter upper bound Delay jitter J is preselected, then a linear relationship exists 
between maxg 2 and B 2 , an allocated bandwidth. 
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ABSTRACT OF THE DISCLOSURE 

The present invention provides a method, computer-readable medium and device 
for dynamically managing allocation of bandwidth in a packet network using a Dynamic 
Setting Scheme (DSS) for Class Based Queuing (CBQ). The method includes the steps 
of maintaining a minimized reserved portion of bandwidth to minimize delay jitter and 
maximizing a shared portion of bandwidth to maximize overall bandwidth utilization. 
Allocation of bandwidth may be based on a sharing tree hierarchical scheme that 
provides for temporary borrowing of bandwidth by real-time applications from 
bandwidth of non-real-time applications and blocks borrowing of bandwidth by non-real- 
time applications from bandwidth of real-time applications. DSS typically provides for 
using measurable parameters, such as queue length and number of borrowing attempts 
per a predetermined length of time/observation window, as control triggers for 
implementing adjustment of bandwidth allocation. In one embodiment, the steps include 
measuring a predetermined parameter at predetermined observation window times and 
dynamically adjusting allocated bandwidth for parent classes of real-time traffic by 
adjusting an average of the predetermined parameter to have a value within a 
predetermined stable region. 
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measuring a predetermined parameter at predetermined observation 

window times 



dynamically adjusting allocated bandwidth for parent classes of real- 
time traffic by adjusting an average of the predetermined parameter to 
have a value within a predetermined stable region 
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Where the predetermined parameter is a number of 
borrowing attempts during a measurement window, a 
maximum bandwidth and a minimum bandwidth for the 
predetermined stable region is determined by: 
IfA i avg < ThrfAt) 10 ™, Bi = maximum^ - m u MinfB,)) 

Else IfA iavg > Thr(Ar per , ft = minimum^ + a* , 
Max(B t )) 

Where exponential smoothing includes: 
Aijxvg <- (l-a)*Ai_avg + a*Ai , where a value of a is 
preselected as a negative power of two and A Lavg is 
updated every observation window, a pre-determined 
parameter in seconds and 

the queue length Qi for class i may be related to the 
upper bound of delay jitter as: 

DelayJitter_i = Qi/Bi 

such that, where the desired jitter upper bound 
Delay jitter_i is given, then a linear relationship exists 
between Qi and Bi (allocated bandwidth) 
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Where the predetermined parameter is a queue length, a lower threshold and an upper threshold 
for queue length for the predetermined stable region may be determined by : 
IfQi_mg < Thr(Qi) hwer , Bi = maximumfBi - a> t ,Mn(B$ 

ElseIfQ i avg > ThrfQ/w", B t = minimum^ + 6> it Max(B^\ 

and Delay Jitter J = maxg, /Bi 

wherein, if a jitter upper bound Delay jitter J is preselected, then a linear relationship 
exists between maxg, and Bi , an allocated bandwidth. 
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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 

name. 

I believe I am an original, first and joint inventor of the subject matter which is 
claimed and for which a patent is sought on the invention entitled Method And Device 
For Efficient Bandwidth Management, the specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims, as amended by an amendment, if any, 
specifically referred to in this oath or declaration. 

I acknowledge the duty to disclose all information known to me which is material 
to patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, 1 19(a- 
d) or 365(a-b) of PCT or foreign application(s) for patent or inventors' certificate listed 
below or priority benefits under 119(e) of any United States provisional application(s) 
listed below and have also identified below any foreign application for patent or 
inventors 5 certificate having a filing date before that of the application on which priority 
is claimed: 

None 

I hereby claim the benefit under Title 35, United States Code, 120 of any United 
States application(s) listed below and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the prior United States application in the manner 
provided by the first paragraph of Title 35, United States Code, 1 12, we acknowledge the 
duty to disclose all information known to us to be material to patentability as defined in 
Title 37, Code of Federal Regulations, 1.56 which became available between the filing 
date of the prior application and the national or PCT international filing date of this 
application: 



None 
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I hereby declare that all statements made herein of my own knowledge are true 
and that all statements made on information and belief are believed to be true; and further 
that these statements were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 
18 of the United States Code and that such willful false statements may jeopardize the 
validity of the application or any patent issued thereon. 

I hereby appoint the following attorney(s) with full power of substitution and 
revocation, to prosecute said application, to make alterations and amendments therein, to 
receive the patent, and to transact all business in the Patent and Trademark Office 
connected therewith: 



Samuel H. Dworetsky 
Thomas A. Restaino 
Robert T. Canavan 
Michele L. Conover 
Cedric G. DeLaCruz 
Rohini K. Garg 
Gregory J. Gorrie 
Thomas JM. Isaacson 



(Reg. No. 27873) 
(Reg. No. 33444) 
(Reg. No. 37592) 
(Reg. No. 34962) 
(Reg. No. 36498) 
(Reg. No. 45272) 
(Reg. No. 36530) 
(Reg. No. 44166) 



Benjamin S. Lee 
Robert B. Levy 
Susan E. McGahan 
Gary H. Monka 
Jeffrey M. Navon 
Alfred G. Steinmetz 
Christine Szwerc 



(Reg. No.42787) 
(Reg. No. 28234 
(Reg. No. 35948) 
(Reg. No. 35290) 
(Reg. No. 32711) 
(Reg. No. 22971) 
(Reg. No. 43177) 



I also appoint Thomas H. Jackson (Reg. No. 29808), Frederic M. Meeker (Reg, 
No. 35282), Joseph P. Krause (Reg. No. 32578) and Darleen J. Stockley (Reg. No. 
34257) of Banner & Witcoff as associate attorney, with full power to prosecute said 
application, to make alterations and amendments therein, and to transact all business in 
the Patent and Trademark Office connected therewith. 



Please address all correspondence to Mr. S. H. Dworetsky, AT&T Corp., P.O. 
Box 4110, Middletown, New Jersey 07748. Telephone calls should be made to Susan E. 
McGahan at 908-221-5776. 
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